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DETAILED ACTION 

1 . The amendment filed July 6, 2005 is entered and claims 1, 3-8, 10-14, 17 and 18 
are pending. 

Drawings 

2. This application, filed under former 37 CFR 1 .60, lacks formal drawings. The 
informal drawings filed in this application are acceptable for examination purposes. 
When the application is allowed, applicant will be required to submit new formal 
drawings. In unusual circumstances, the formal drawings from the abandoned parent 
application may be transferred by the grant of a petition under 37 CFR 1 .182. 

Response to Arguments 

3. Applicant's arguments with respect to claims 1, 3-8, 10-14, 17 and 18 have been 
considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 
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Claims 1 , 4-7, 11-14 and 17 are rejected under 35 U.S.C. 102(b) as being 
unpatentable over US Patent 4,988,981 by Zimmerman et al. 

Regarding claim 1 , Zimmerman et al. teach a device providing a display screen 
and performing predetermined processing by operating a pointer displayed on the 
display screen the device (the control signals are used to manipulate a graphical 
representation of the operator's hand which is displayed on a monitor coupled to the 
computer system, and the graphical representations of the operator's hand 
manipulates virtual objects or tools also displayed by the computer (abstract)) 
comprising: 

a display controller for controlling a display position of the pointer on the display 
screen (host computer, Fig.1 (16) which inherently includes a display controller to 
control display 28); 

a displacement detector for detecting a displacement of the device itself (the 
glove assembly 12 contains sensors that detect the flexing of the fingers and 
other gestures of the hand of an operator (column 3, lines 22-24); and 

a pointer moving device for moving the pointer on the display screen based on 
the detected displacement of the device itself (the present invention is especially well 
adapted for use with a pictorial or symbolic programming language having a dynamic 
cursor which corresponds in shape to the shape of the glove and moves on the screen 
in response to movement of the glove in space(column 2, lines 44-48), 

wherein the displacement detector comprising an image sensor wherein image 
sensed by the image sensor is processed to obtain a displacement of the device itself 
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(a glove worn on the hand which includes sensors for detecting the gestures of the 
hand, as well as hand position sensing means coupled to the glove and to the 
computer system for detecting the position of the hand with respect to the system 
(abstract)). 

Regarding claim 4, Zimmerman et al. teach the image sensor comprising an 
infrared sensor (the light source 44 is preferably an infrared light emitting diode 
(column 4, lines 27 and 28)). 

Regarding claim 5, Zimmerman et al. teach an operator for activating the image 
sensor (the graphical representations of the operator's hand manipulates virtual objects 
or tools also displayed by the computer (abstract)). 

Regarding claim 6, Zimmerman et al. teach the operator further includes the 
function for directing a selection an object pointed to by the pointer or for the execution 
of predetermined processing defined for the object whereby the operator has a plurality 
of functions (glove assembly 12 contains sensors that respond to the gestures of the 
operator's hand. The software receives and interprets gesture indicating data from the 
sensors of the glove assembly 12 and enters commands into the computer 16 
according to the gestures recognized. These commands relate to the manipulation of 
virtual objects created by the computer 16 and displayed on the display screen 28 
(column 4, lines 55-62)) where different gestures represent plurality of function. 

Regarding claim 7, Zimmerman et al. teach the device is of a wristwatch type 
(the forward and back flexing of the wrist can indicate vertical positioning of the screen 
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cursor 26, while left and right flexing of the wrist can indicate horizontal positioning of 
the screen cursor (column 5, lines 41-44)). 

Regarding claim 1 1 , Zimmerman et al. teach a method for moving a 
position pointer displayed in a display of a device (the present invention is especially 
well adapted for use with a pictorial or symbolic programming language having a 
dynamic cursor which corresponds in shape to the shape of the glove and moves on 
the screen in response to movement of the glove in space (column 2, lines 44-48), 
comprising: 

a first step of using an image sensor to take an image of a physical object facing 
the device continuously and detecting a relative displacement between the taken object 
and the display (As the user of the system moves his hand in space, the position and 
orientation of the glove are continuously detected by the computer system as shown by 
block 140. After each determination of the position of the glove, the display 28 is 
updated to reflect the new glove position and orientation, as indicated by block 142. 
After the display is updated, the position and orientation of the glove are checked to 
determine whether an object has been "picked up" on the screen. This may be 
achieved using any desired well known algorithm, for example, by determining whether 
at least two points on the representation of the glove are coincident with at least two 
points on the object (column 6, lines 16-28)); and 

a second step for changing a display position of the pointer displayed on the 
display based on the detected displacement (the present invention is especially well 
adapted for use with a pictorial or symbolic programming language having a dynamic 
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cursor which corresponds in shape to the shape of the glove and moves on the screen 
in response to movement of the glove in space (column 2, lines 44-48). 

Regarding claim 12, Zimmerman et al. teach calculating a motion vector at a 
certain place in an image based on be movement of the image that was taken multiple 
times and obtaining a relative displacement between the object and display based on 
the calculated motion vector (As the user of the system moves his hand in space, the 
position and orientation of the glove are continuously detected by the computer system 
as shown by block 140. After each determination of the position of the glove, the 
display 28 is updated to reflect the new glove position and orientation, as indicated by 
block 142. After the display is updated, the position and orientation of the glove are 
checked to determine whether an object has been "picked up" on the screen. This 
may be achieved using any desired well known algorithm, for example, by determining 
whether at least two points on the representation of the glove are coincident with at 
least two points on the object (column 8, lines 16-28)). 

Regarding claim 13, Zimmerman et al. teach moving the device relative to the 
object the relative displacement between the object and the display is obtained by 
inverting a sign of the motion vector (As the user of the system moves his hand in 
space, the position and orientation of the glove are continuously detected by the 
computer system as shown by block 140. After each determination of the position of 
the glove, the display 28 is updated to reflect the new glove position and orientation, as 
indicated by block 142. After the display is updated, the position and orientation of the 
glove are checked to determine whether an object has been "picked up" on the screen. 
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This may be achieved using any desired well known algorithm, for example, by 
determining whether at least two points on the representation of the glove are 
coincident with at least two points on the object (column 8, lines 16-28)) where the 
user's hand is inherently capable of moving forward and backward to create two 
position points that are opposite to each other. 

Regarding claim 14, Zimmerman et al. teach generating a time-series moving 
pattern of a certain place based on a position of the certain place in a principal image 
and position of a place corresponding to the certain place in a plurality of other images 
that were taken apart in time from the principal image (The hand position sensing 
means preferably includes one or more ultrasonic transmitters affixed to the glove 
assembly, a stationary receiver comprising three separate spaced-apart ultrasonic 
receiving units, and a control circuit that measures the time delay of pulsed ultrasonic 
signals from the transmitter to the three receivers. The time delay provides a measure 
of the spatial position of the operator's hand. The signal processing means includes 
interface circuitry for coupling the glove to the host computer, for positioning a hand- 
shaped cursor on the display screen of the computer according to the position of the 
operator's hand, for responding to output signals from the flex sensors, and for 
manipulating virtual objects defined by the computer according to commands 
represented by the gestures and movement of the operator's hand (column 2, lines 21- 
36); and 
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comparing the generated time-series moving pattern with a plurality of model 
patterns registered in advance to select a most approximate model pattern 
(Comparator U31 compares a reference voltage Vr with the potential on the 
Y output terminal. When the Y output terminal exceeds the reference voltage, 
which is approximately 2/3 of 5 volts, the output of comparator U31 goes to 
ground potential. This drop in potential on node IF is interpreted by the host 
computer as an interrupt signal (column 7, lines 29-35); 

wherein the second step comprising the steps of changing a display position of 
the pointer based on a moving pattern that was defined for the selected model pattern 
(As the user of the system moves his hand in space, the position and orientation of the 
glove are continuously detected by the computer system as shown by block 140. After 
each determination of the position of the glove, the display 28 is updated to reflect the 
new glove position and orientation, as indicated by block 142. After the display is 
updated, the position and orientation of the glove are checked to determine whether an 
object has been "picked up" on the screen. This may be achieved using any desired 
well known algorithm, for example, by determining whether at least two points on the 
representation of the glove are coincident with at least two points on the object (column 
8, lines 16-28)). 

Regarding claim 17, Zimmerman et al. teach the image sensor is located in a 
part of the display screen (the glove assembly 12 contains sensors that detect the 
flexing of the fingers and other gestures of the hand of an operator, and also contains 
one or more ultrasonic transducers 17 for transmitting signals to receivers 20 to enable 
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detecting the spatial position of the glove assembly 12 with respect to the computer 
display (Figure 1)). 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claim 3 are rejected under 35 U.S.C. 103(a) as being unpatentable over US 

Patent 4,988,981 by Zimmerman et al. in view of US Patent # 5,502,568 ("Ogawa et 

al."). 

Regarding claim 3, Zimmerman et al. teach a device providing a display screen and 
performing predetermined processing by operating a pointer displayed on the display 
screen the device (the control signals are used to manipulate a graphical 
representation of the operator's hand which is displayed on a monitor coupled to the 
computer system, and the graphical representations of the operator's hand 
manipulates virtual objects or tools also displayed by the computer (abstract)). 
Accordingly, the prior art teaches all the claim limitations as recited in claim 3 with the 
exception of providing a complementary metal-oxide semiconductor or a charge 
coupled device. 

However, Ogawa et al. teaches a CCD area image sensor Fig.9 (53). 
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Thus, it would have been obvious to a person of ordinary skill in the art at the 
time the invention was made to utilize the CCD as taught by Ogawa et al. in the 
computer data entry disclosed by Zimmerman et al. because this would provide an 
optical position detecting unit including a light beam direction detecting section capable 
of detecting the direction of incidence of light with high accuracy without using optical 
lenses (column 2, lines 5-9). 

6. Claims 8, 10 and 18 are rejected under 35 USC 103 (a) as being unpatentable 
over US Patent # 6,137,479 by Olsen et al. in view of US Patent # 5,050,1 16 
("Stahnke") in further view of US Patent # 4,998,981 by ("Zimmerman et al."). 

Regarding claim 8, Olsen et al. teach a wristwatch type device (the mouse watch 
Fig.4C (54)) comprising: 

display for displaying a screen (display, Fig.4C (72)); 

a case for supporting the display (a computer mouse housing 88 contains the 
components that perform the traditional computer mouse functions (e.g., the computer 
mouse 84) (Fig.7)); 

an attached belt attached to the case (wristband, Fig.5 (76)). Accordingly, the 
prior art teaches all the claim limitations as recited in claim 8 with the exception of 
providing a touch sensor mounted in the case or the attached belt for performing a 
predetermined operation on an object displayed on the screen, wherein the touch 
sensor is provided on both sides of the display and an image sensor wherein an image 
sensed by the image sensor processed to obtain a displacement of the device itself. 
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However, Stahnke teach touch sensors are arranged on the keys of both 
center columns of each key group 2 and 3 which control display markers 6 and 7 
on the display screen 1 (column 4, lines 9-12) where the touch sensors are mounted 
on the housing or casing of the keyboard. 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to utilize the touch sensors taught by Stahnke in the mouse watch 
disclosed by Olsen et al because this would provide to the hands operating the groups 
of keys an orientation above the keys with respect to the correct position of the hands. 
Accordingly, the combination of Olsen et al. and Stahnke teaches all the claim 
limitation with the exception of providing and image sensor. However, Zimmerman et 
al. teach a glove worn on the hand which includes sensors for detecting the gestures of 
the hand, as well as hand position sensing means coupled to the glove and to the 
computer system for detecting the position of the hand with respect to the system 
(abstract)). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to utilize the sensors as taught by Zimmerman et al. in the 
combination of Olsen et al. and Stahnke because this would provide an apparatus and 
method for entering data into a computer and manipulating virtual objects defined by 
the computer based on the gestures and positions of the hand, or other parts of the 
body, of an operator (column 1, lines 12-16). 

based on the detected results, thereby moving the pointer displayed on the 
screen (a glove worn on the hand which includes sensors for detecting the gestures of 
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the hand, as well as hand position sensing means coupled to the glove and to the 
computer system for detecting the position of the hand with respect to the system 
(abstract)). 

Regarding claim 10, Zimmerman et al teach displacement detection section for 
detecting a displacement of the display (movement by the glove assembly 12 in a 
plane parallel to that of the display screen 28 results in corresponding movement by 
the cursor 26 (column 3, lines 46-49); and 

pointer position changing device for changing a display position of a pointer 
based on the detected results, thereby moving the pointer displayed on the screen (a 
glove worn on the hand which includes sensors for detecting the gestures of the hand, 
as well as hand position sensing means coupled to the glove and to the computer 
system for detecting the position of the hand with respect to the system (abstract)). 

Regarding claim 18, Zimmerman et al. teach the image sensor is located in a 
part of the display (the glove assembly 12 contains sensors that detect the flexing of 
the fingers and other gestures of the hand of an operator, and also contains one or 
more ultrasonic transducers 17 for transmitting signals to receivers 20 to enable 
detecting the spatial position of the glove assembly 12 with respect to the computer 
display (Figure 1)). 

Conclusion 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jean Lesperance whose telephone number is (571) 
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272-7692. The examiner can normally be reached on from Monday to Friday between 
10:OOAM and 6:30PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Patrick Edouard, can be reached on (571) 272-7603. 
Any response to this action should be mailed to: 
Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
or faxed to: 

(571 ) 273-8300 (for Technology Center 2600 only) 
Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 

drive, Arlington, VA, Sixth Floor (Receptionist). 

Any inquiry of a general nature or relating to the status of this application or 

proceeding should be directed to the technology Center 2600 Customer Service Office 

whose telephone number is (703) 306-0377. 

Jean Lesperance 

[JCou^- IXjLj ^ — 

Date 9/15/2005 

Art Unit 2674 J) 
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SUPERVISORY PATENT EXAMINER 



